Safe Model-Based Multi-Agent Mean-Field Reinforcement Learning

Many applications, e.g., in shared mobility, require coordinating a large number of agents. Mean-field reinforcement learning addresses the resulting scalability challenge by optimizing the policy of a representative agent. In this paper, we address an important generalization where there exist global constraints on the distribution of agents (e.g., requiring capacity constraints or minimum coverage requirements to be met). We propose Safe-$\text{M}^3$-UCRL, the first model-based algorithm that attains safe policies even in the case of unknown transition dynamics. As a key ingredient, it uses epistemic uncertainty in the transition model within a log-barrier approach to ensure pessimistic constraints satisfaction with high probability. We showcase Safe-$\text{M}^3$-UCRL on the vehicle repositioning problem faced by many shared mobility operators and evaluate its performance through simulations built on Shenzhen taxi trajectory data. Our algorithm effectively meets the demand in critical areas while ensuring service accessibility in regions with low demand.Comment: 25 pages, 14 figures, 3 table

Three dimensional evaluation of posture in standing with the PosturePrint: an intra- and inter-examiner reliability study

Abstract Background Few digitizers can measure the complexity of upright human postural displacements in six degrees of freedom of the head, rib cage, and pelvis. Methods In a University laboratory, three examiners performed delayed repeated postural measurements on forty subjects over two days. Three digital photographs (left lateral, AP, right lateral) of each of 40 volunteer participants were obtained, twice, by three examiners. Examiners placed 13 markers on the subjects before photography and chose 16 points on the photographic images. Using the PosturePrint® internet computer system, head, rib cage, and pelvic postures were calculated as rotations (Rx, Ry, Rz) in degrees and translations (Tx, Tz) in millimeters. For reliability, two different types (liberal = ICC3,1 & conservative = ICC2,1) of inter- and intra-examiner correlation coefficients (ICC) were calculated. Standard error of measurements (SEM) and mean absolute differences within and between observers' measurements were also determined. Results All of the "liberal" ICCs were in the excellent range (> 0.84). For the more "conservative" type ICCs, four Inter-examiner ICCs were in the interval (0.5–0.6), 10 ICCs were in the interval (0.61–0.74), and the remainder were greater than 0.75. SEMs were 2.7° or less for all rotations and 5.9 mm or less for all translations. Mean absolute differences within examiners and between examiners were 3.5° or less for all rotations and 8.4 mm or less for all translations. Conclusion For the PosturePrint® system, the combined inter-examiner and intra-examiner correlation coefficients were in the good (14/44) and excellent (30/44) ranges. SEMs and mean absolute differences within and between examiners' measurements were small. Thus, this posture digitizer is reliable for clinical use

Myśl i polityka: księga pamiątkowa dedykowana profesorowi Jackowi Marii Majchrowskiemu T. 2

Publikacja jubileuszowa z okazji 40-lecia pracy naukowej profesora Jacka Majchrowskieg

Forward-central two-particle correlations in p-Pb collisions at root s(NN)=5.02 TeV

Two-particle angular correlations between trigger particles in the forward pseudorapidity range (2.5 2GeV/c. (C) 2015 CERN for the benefit of the ALICE Collaboration. Published by Elsevier B. V.Peer reviewe

Event-shape engineering for inclusive spectra and elliptic flow in Pb-Pb collisions at root(NN)-N-S=2.76 TeV

Peer reviewe

Elliptic flow of muons from heavy-flavour hadron decays at forward rapidity in Pb-Pb collisions at root s(NN)=2.76TeV

The elliptic flow, v(2), of muons from heavy-flavour hadron decays at forward rapidity (2.5 <y <4) is measured in Pb-Pb collisions at root s(NN)= 2.76TeVwith the ALICE detector at the LHC. The scalar product, two- and four-particle Q cumulants and Lee-Yang zeros methods are used. The dependence of the v(2) of muons from heavy-flavour hadron decays on the collision centrality, in the range 0-40%, and on transverse momentum, p(T), is studied in the interval 3 <p(T)<10 GeV/c. A positive v(2) is observed with the scalar product and two-particle Q cumulants in semi-central collisions (10-20% and 20-40% centrality classes) for the p(T) interval from 3 to about 5GeV/c with a significance larger than 3 sigma, based on the combination of statistical and systematic uncertainties. The v(2) magnitude tends to decrease towards more central collisions and with increasing pT. It becomes compatible with zero in the interval 6 <p(T)<10 GeV/c. The results are compared to models describing the interaction of heavy quarks and open heavy-flavour hadrons with the high-density medium formed in high-energy heavy-ion collisions. (C) 2015 CERN for the benefit of the ALICE Collaboration. Published by Elsevier B.V.Peer reviewe

Measurement of charged jet production cross sections and nuclear modification in p-Pb collisions at root s(NN)=5.02 TeV

Charged jet production cross sections in p-Pb collisions at root s(NN) = 5.02 TeV measured with the ALICE detector at the LHC are presented. Using the anti-k(T) algorithm, jets have been reconstructed in the central rapidity region from charged particles with resolution parameters R = 0.2 and R = 0.4. The reconstructed jets have been corrected for detector effects and the underlying event background. To calculate the nuclear modification factor, R-pPb, of charged jets in p-Pb collisions, a pp reference was constructed by scaling previously measured charged jet spectra at root s = 7 TeV. In the transverse momentum range 20Peer reviewe